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ON THE STRUCTURE OF QUASI-STATIONARY 
COMPETING PARTICLE SYSTEMS 1 

By Louis-Pierre Arguin and Michael Aizenman 

Princeton University 

We study point processes on the real line whose configurations 
X are locally finite, have a maximum and evolve through increments 
which are functions of correlated Gaussian variables. The correlations 
are intrinsic to the points and quantified by a matrix Q — {qij }ijeN- A 
probability measure on the pair (X, Q) is said to be quasi-stationary 
if the joint law of the gaps of X and of Q is invariant under the 
evolution. A known class of universally quasi-stationary processes is 
given by the Ruelle Probability Cascades (RPC), which are based on 
hierarchically nested Poisson-Dirichlet processes. It was conjectured 
that up to some natural superpositions these processes exhausted the 
class of laws which are robustly quasi-stationary. The main result of 
this work is a proof of this conjecture for the case where qij assume 
only a finite number of values. The result is of relevance for mean-field 
spin glass models, where the evolution corresponds to the cavity dy- 
namics, and where the hierarchical organization of the Gibbs measure 
was first proposed as an ansatz. 

1. Introduction. 

1.1. The problem. A competing particle system is a point process on K 
whose configurations can be ordered, that is have a maximum and are lo- 
cally finite, and which evolve here in discrete time steps. We are interested in 
the situation where the points represent the location of entities which have 
intrinsic characteristics that are of relevance for their dynamics. In the case 
discussed here, these are not affected by the time evolution and in particu- 
lar by the particles' evolving positions on the line. The evolution is random, 
with steps which in any given time-increment are correlated through the 
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points' characteristics. The process is said to be quasi- stationary if the joint 
distribution of the gaps among the points along with their characteristic fea- 
tures is stationary in time. Our goal is to characterize processes which are 
endowed with a robust quasi-stationarity property. We prove, under some 
simplifying restrictions, that such a condition requires the process to be or- 
ganized as a hierarchical random probability cascade, RPC — an acronym 
which can also be read as Ruelle Probability Cascade. This remarkable fam- 
ily of processes was introduced in the study of spin-glass models [9, 15, 16], 
for which it plays a fundamental role [1], and it has attracted a great deal 
of attention since [8]. 

More explicitly, in the system under consideration, the configuration of 
the process is given by: 

1. an ordered sequence of positions, X = {Xi}i £ fq C K, with X\ > X2 > • ■ • , 
and 

2. a so-called overlap matrix, which is a positive definite quadratic form 
given by Q = {qij}, with q„ = 1 for all i G N (and hence \qij\ < 1). 

The time evolution is given by correlated increments, Xi 1— ► Xi + ip(ni), 
where k is a Gaussian field on N, independent of X with covariance given 
by the matrix Q, and tp is a real function. This is followed by a reordering 
of the indices, denoted by j, so that the full evolution step is 

(1.1) (X,Q)^(X',Q') 

with 

X' = (Xi + 4>(Ki),ie N), = (X n - Hm) + ^(« 7r -i (m) ),mG N), 

(1-2) 

Q = {^Tr-HmK-^n)}* 

where ir is the permutation of N induced by j: ir(i) = m if the ith point in 
X is mapped to the mth point in X' . If such a permutation does not exist, 
the evolution is not defined. 

It may be remarked here that with a suitable choice of ip any random vari- 
able may be presented as a function of a Gaussian, ip(K,). This formulation 
is, however, convenient for the description of the structure of correlations 
between the variables encountered here. With the assumptions which are 
spelled below on tp it also carries some mild implications on the distribution 
of a single incremental variable (continuity of its distribution, and finiteness 
of its moment generating function) . 

The above evolution can be regarded as a competition within a crowd 
of points. While the labels (i) change according to the relative positions, 
the covariances q^ are intrinsic to the particles. A crucial feature of this 
dynamical system is that both the position and the matrix of overlaps are 
random — the relevant stochastic object is the pair (X, Q). 
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The present work addresses the question of describing the collection of 
distributions of (X, Q) which are quasi- stationary under the above evolu- 
tion, in the sense that the joint law of the gaps, {Xi — Xj + i}j g N, and is 
invariant under the evolution. In the particular case where Q is the identity, 
that is the increments are independent, Ruzmaikina and Aizenman [17] have 
shown that a quasi-stationary process X must be a superposition of Poisson 
processes with exponential density. The aforementioned Ruelle probability 
cascades form a broader class of processes, with Q not limited to the iden- 
tity matrix. Each process in this collection is quasi-stationary under any 
dynamics of the above form with an exponentially bounded ip, and the class 
is parametrized by probability measures on [0,1]. It was conjectured that 
this collection includes all the processes which are robustly quasi-stationary. 
The significance of this conjecture for spin glass models is discussed in [2]. 

The RPC measures incorporate an interesting hierarchical structure. That 
can alternatively be expressed by the statement that the metric induced by 
the overlaps, dij = ^/l — qij, is almost surely ultrametric, in the sense that 

dij < max{4,4j} 

for any triplet i,j, k. The inequality can equivalently be expressed by saying 
that the condition q^ > r is transitive, as a condition on pairs {i,j} C N. In 
such case, the set of points endowed with the distance d has a tree structure 
and the overlap matrix is the covariance matrix of the Gaussian field on the 
tree. 

The main result of this work establishes the above conjecture in the case 
of systems that are quasi-stationary in a robust sense and for which the set 
of values taken by the covariances of the point i is finite. The result is stated 
precisely in Theorem 1.8, in the next section, where the necessary concepts 
are introduced. 

Our interest in this problem is partially motivated by the desire to shed 
light on the properties of mean-field spin glass systems. It is believed that the 
equilibrium states of a wide class of such models are organized in an ultra- 
metric fashion (among them the Sherrington-Kirkpatrick model for which 
this assumption leads to the correct free energy per particle [2, 12, 19]). It 
has been an interesting question of what is at the root of that. Since it makes 
sense to expect the law of the corresponding Gibbs states to be asymptot- 
ically invariant under a so-called cavity dynamics (see, e.g., [2, 11]), which 
has exactly the form (1.4), the result presented here may provide a step 
toward the explanation of this phenomenon. 

1.2. Competing particle systems and random overlap structures. A con- 
venient setup for our discussion is to regard the random pair (X, Q) as a 
random overlap structure or ROSt. This concept was introduced in the study 
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of mean-field spin glass systems where it provides a useful framework [1]. Its 
significance for the Parisi solution of the SK model was discussed in [2, 4]. 

The requirement that the evolving configuration of particles will admit 
sequential order with probability one is assured by the convenient condition, 
which is also natural for our result, that for some (5 > the point process 
satisfies 



(For finite configurations, it should be understood that X\ = — oo for all but 
a finite number of points.) 

Point processes of the above kind are closely related to random mass- 
partitions [7]. A mass-partition is a sequence (si,i G N) such that si > S2 > 
• • • > and Ya s i — 1- It 1S sa, id to be proper if J2i Si = l. The space P m of 
mass-partition is usually endowed with the metric d(s,s') = maxj g N{|sj — 
s^|}. Under this metric, P m is a compact separable space. The matrix Q 
associated to X takes value in the space Q of real symmetric positive semi- 
definite forms N x N for which the diagonal is normalized to 1. Elements of 
this space are called overlap matrices by analogy with spin glass systems. We 
endow this space with the topology it inherits as a subset of the compact 
space [— l,l] NxN equipped with the product topology. This space is then 
metrizable, compact and separable. 

Definition 1.1 (ROSt 2 ). The space of overlap structures £l os is the 
compact separable metric space P m x Q. We write T os for the Borel a- 
algebra on £l os . A random overlap structure or ROSt is an element of 
Mi(Cl 0S ), the space of regular probability measure on (^los^os), for which 
Q is almost surely positive definite. 

We will usually write P for the law of a random overlap structure (£, Q) 
and E for its expectation. A basis for the topology of £l os are the open sets 
of the form 



for some n G N and open sets Ij C [0, 1], Aij C [—1, 1]. It is clear from the 
basis generating T s that the law P of a ROSt is determined by the expected 
value of measurable functions that depend only on a finite number of points. 
This class can be further restricted to continuous functions by a simple 
application of the Stone- Weierstr ass theorem, and one has: 



2 The notion of random overlap structures [1, 2] could conceivably be discussed in the 
more general case, where £ is taken to be a random finite measure on a measure space A 
and Q a positive semi-definite form on A. Our definition corresponds to the case A = N. 



(1.3) 




a.s. 



B(n,{Ii},{Aij}) = {(s,Q):si G Ii,qij G Aij VI < i,j < n} 
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Proposition 1.2. Let (£,Q) and (£',<?') be two ROSt's. Let C n (Q os ) 
be the class of continuous functions on Q os that only depend on the positions 
and the overlaps of the first n points. If ¥,[f(^,Q)] = E[/(£', Q')] for every 
f E C Tl {Q 0S ) and n G N, then (£, Q) and (£',Q') have the same law. 

To every pair (X, Q) with X satisfying the condition (1.3), we associate 
a ROSt (£, Q) by simply taking, for some [3 > 0: 

Because of the normalization, the law of £ depends only on the law of the 
gaps of X. Hence quasi-stationarity of (X, Q) under the correlated evolution 
(1.1) is equivalent to the invariance of the law of (£, Q) under the stochastic 
map 

(1.4) (g,Q) » ^ {K) (H,Q) ■= (( = ^ e ^ Kj) ,i € Nj .ttQtt-^, 

where, for simplicity, we incorporated the factor f3va.il). The symbol J means 
that the weights are reordered in decreasing order after evolution. Again, 
the permutation tt reflects the reordering, namely ir(i) = m if the ith weight 
becomes the mth weight after evolution. From now on, we will identify a 
permutation matrix, tt, with the corresponding permutation matrix, mj = 1 
if ir(i) = j and otherwise. With this notation, the evolved overlap matrix 
{lir- 1 (m)ir- 1 (n)} becomes 7r(5vr _1 . A sufficient condition for the mapping to 
be nonsingular, that is, with 2i£i e ^ K ^ finite a.s., is the finiteness of the 
expectation of e^ Ki ). In fact, we will assume the following condition, which 
suffices for this purpose, and also guarantees that the increments admit a 
continuous range of values (and in particular are not supported on a lattice) . 

Assumptions 1.3. The function ip :R — > R is a Borel measurable func- 
tion satisfying 

r p-z 2 /2 

/ -^e x ^ z Uz<oo 

JR \/27T 

for any AgR. Furthermore, for Y a standard Gaussian variable the law of 
ip(Y) is absolutely continuous with respect to the Lebesgue measure. 

Assumption 1.3 is in particular fulfilled by any function in C 2 (R) with 
bounded derivatives, for example: = K and = log cosh k. In the 

linear case, the evolution of log£ is by Gaussian increments. The second 
example is of particular interest for the SK spin glass model. 
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It is straightforward to check that the mapping $(.)(•) in (1.4) as a map- 
ping from M N x tt os to Q os is jointly measurable. This guarantees that 
^i>M (£> Q) 1S wen defined as a ROSt induced by the laws of k and (£, Q). 

There are natural variations of the mapping (1.4) that will be of impor- 
tance in our study. Let Q* r denote the rth power, r G N, of the matrix Q 
in the sense of the entry-wise product. By a known theorem of Schur, if Q 
is positive definite so is Q* r [14]. The stochastic mapping (1.4) can then be 
considered for a Gaussian field k with covariance Q* r for some r G N. 

Definition 1.4 (Correlated evolution). A correlated evolution on 17 os 
is a stochastic mapping of the form (1.4), for which the increments are ip(n) 
with k a centered Gaussian field with covariance E[«i«j] = g(qij), for some 
g G C(U) and ip a function satisfying Assumption 1.3. 

As the function ip will often be fixed, we will sometimes drop the depen- 
dence on ip and the Gaussian field in the notation. We will write <3? r for the 
correlated evolution with g(q) = q r , corresponding to the covariance Q* r . 
Moreover, P r will denote the probability measure on os x M N given by 

(1.5) dF r (i,Q,K) :=dP(Z,Q)dv Q »-(K), 

where vq*t is the Gaussian measure with covariance Q* r . 

Our original challenge translates into characterizing the random overlap 
structures that are quasi-stationary under some correlated evolution. 

Definition 1.5 (Quasi- stationarity) . Let ip be a function satisfying As- 
sumption 1.3: 

• A ROSt (£, Q) is said to be quasi-stationary under the correlated evolution 
$ r if and only if 

<S>r(^Q) = (tQ), 

where the symbol = means equality in distribution. 

• A ROSt (£, Q) is said to be robustly quasi-stationary if and only if it is 
quasi-stationary under <£ r for r = 1 and an infinite number of r G N. 

The ROSt consisting of only one point is trivially quasi-stationary. Further- 
more, it is easy to see that under the dynamics discussed above any point 
process with finitely many points will converge to this trivial case (the distri- 
bution of the gaps would spread indefinitely). Hence, we focus our attention 
on systems with infinitely many particles. 

For a fixed ip the subset of robustly quasi-stationary laws of A4i(£l os ) is 
plainly convex. It can be checked that it is also closed in the weak topology 
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induced by C(Q 0S ) on A4i(£l os ). As Q os is a separable compact Hausdorff 
space, Choquet's theorem ensures that any robustly quasi-stationary law is a 
linear superposition of the extreme measures (see, e.g., [18], page 63). In our 
case, these extreme or ergodic measures are exactly the ones for which the 
$ r -invariant functions are constant for all r G N. The $ r -invariant functions 
are the bounded measurable functions / : Q os — > R such that 

®rif(Mt;,Q)M,Q)f= s 'f&Q), 

where E[-|JT] denotes the conditional expectation with respect to the a- 
algebra generated by the random variable X. 

1.3. Q -factorization. For a given ROSt (£, Q), we denote 
Sq ■= {qij ■ 1 < i < j < oo} 

and 

Sq(*) --{Qij-j^i}- 

A ROSt is said to have a finite state space if ISq^oo a.s. In this work we 
consider only such systems. Note that the cardinality of the state space Sq 
is a ^-invariant function for all r G N. If (£, Q) is ergodic then Sq is a 
deterministic set. 

Definition 1.6. A ROSt (£,Q) is said to be overlap-indecomposable, or 
simply indecomposable, if 

S Q (i)=S Q foralHGN. 

The set Sq(i) provides a tag according to which the points may be parti- 
tioned in a time independent fashion. Precisely, for any subset A of Sq, one 
defines I a ■ = {i- SQ(i) = A}. A nonempty element I a in this partition gives 
rise to a ROSt as follows 

(€,Q)a ■= (feje I A),Uij}i,jei A )- 

Each of these would be quasi-stationary if (£, Q) was. ROSt's (£, Q)a need 
not be indecomposable, since the collection of overlaps of i within the lim- 
ited collection I a could in principle be smaller than A. However, successive 
applications of such a partitioning of the index set reduce the size of the 
set Sq, and thus after not more than \Sq\ steps it produces indecompos- 
able ROSt's. We refer to the partition of the configuration according to this 
algorithm as the Q-factorization of The ROSt's which describe the 

different elements of the above partition are referred here as the Q-factors of 
(£,<3). The above considerations readily lead to the following factorization 
statement. 
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Proposition 1.7. Let (£,Q) be a ROSt with finite state space that is 
quasi-stationary under a correlated evolution <£. Then the Q -factorization 
yields a time-invariant partition of the point process into indecomposable 
quasi- stationary ROSt's. 

Ruelle probability cascades provide a class of random overlap structures 
that are robustly quasi-stationary and indecomposable. These processes, 
whose structure is motivated by the Parisi hierarchical ansatz [15], were 
introduced by Ruelle in the context of mean-field spin glass systems, as 
representing the asymptotics of the models studied by Derrida [9, 16]. An 
insightful description of RPC through a coalescence process was provided 
by Bolthausen and Sznitman [8]. In the terminology which is explained in 
Section 2, a Ruelle probability cascade is a random pair (£, Q) where £ is 
a Poisson-Dirichlet process PD(x,0), x € (0,1), and Q has a hierarchical 
structure. 

1.4. Statement of the result. The main result proven here is: 

Theorem 1.8. Let tp 6 C 2 (M) be nonconstant with bounded derivatives, 
and Ao > 0. If a ROSt is robustly quasi- stationary and ergodic for all mul- 
tiples \Tp with | A] < Ao, then each of its Q -factors is a Ruelle probability 
cascade. In particular, within each Q -factor, the overlaps {qij} are nonneg- 
ative and ultrametric almost surely. 

We note that in the case iP(k) = k quasi-stationarity for only one A is 
needed. Moreover, this A can depend on the power of the covariance matrix 
(cf. Theorem 4.4). It would be interesting to investigate the case of infinite 
state space, which eludes the approach developed here (see [6] for preliminary 
results). The proof of the theorem is given in Section 4, through steps which 
are outlined next. 

1.5. Outline of the proof. The article is organized as follows. Section 2 
presents in detail the definition of the Ruelle probability cascades with an 
emphasis on the quasi-stationarity property. The derivation of the Theorem 
1.8 is then divided into four steps. 

(i) The free evolution (Section 3). As it turns out, it is important to 
understand the condition of quasi-stationarity of random overlap structures 
under the "free," that is overlap-independent evolution — for which the Gaus- 
sian variables k are taken to be i.i.d. random variables. For point processes 
without the overlap degrees of freedom it is known that, under a nonlat- 
tice condition, quasi-stationarity implies that the law of £ is a linear su- 
perposition of Poisson-Dirichlet processes PD(x,0) [5, 17]. Random overlap 
structures include also the overlap matrix. For those we prove: 
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Theorem 1.9. Let (£,Q) be a ROSt that is quasi- stationary under the 
free evolution for a function if; satisfying Assumption 1.3. There exists a 
random probability measure fi on a Hilbert space 7i such that conditionally 
on \x: 

1. the law of £ is a linear superposition of PD(x,0) independent of Q; 

2. Q is directed by fi, that is: for i^ j 

Qij = {4>iAj)n, 
where (^,jGN) is i.i.d. ^-distributed. 

The proof is based on the fact that the law of Q must be invariant under 
the action of any finite permutation (such a random matrix is said to be 
weakly exchangeable [3]). Once this fact is proven, we can apply a variation 
of de Finetti's theorem due to Dovbysh and Sudakov [10] (see also Hestir 
[13]). This result states that the law of a weakly exchangeable N x N co- 
variance matrix is directed by a random probability measure \i similarly to 
the way that the empirical measure directs the distribution of an exchange- 
able sequence in the original de Finetti's theorem. The distribution of £ is 
obtained through an adaptation of the Ruzmaikina-Aizenman theorem [17] 
on processes which are quasi-stationary under independent increments [5]. 

(ii) Robustness and free evolution (Section 4.1). Next, we show: 

Theorem 1.10. Q) is a ROSt that is robustly quasi-stationary for 

some function ip satisfying Assumption 1.3, then it is also quasi- stationary 
under the free evolution. 

In essence, this follows from the fact that, under our assumptions on Q, 
Q* r tends to the identity matrix as r — > oo. By Theorems 1.9 and 1.10 yields 
a characterization of the law of £. It remains to single out the distribution 
of the directing measure. For that we consider the further implications of 
quasi-stationarity. 

(iii) The directing random overlap structure (Section 4.2). Pointwise, the 
directing measure fi, which we recall is defined for each (or almost every) 
configuration (£, Q), evolves under the correlated evolution. However, under 
the quasi-stationarity assumption its law should be invariant. In Appendix 
A, we prove that under the assumptions of indecomposability and finite- 
ness of the state space, the directing measure on 7i is discrete, of the form 
fi = J2i£c£rf<i)i f° r some countable collection of vectors (4>i,l G C). Hence 
fx can be represented by (£, Q) where £ are the ordered weights and Q is 
the Gram matrix of the vectors (with diagonal normalized to 1). (£,Q) is 
called the directing ROSt. It is rather simple to write down the evolution 
of this new random overlap structure relying heavily on the fact that £ is 
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a Poisson-Dirichlet variable. The astounding fact is that (£, Q) undergoes 
also an evolution of the form (1.4). However, this evolution is governed by 
a slightly different function tp which explicitly depends on r. These results 
are summarized in Proposition 4.3. 

(iv) The induction argument (Sections 4.3 and 4.4). The RPC's admit 
a directing ROSt. Curiously, this structure is again a cascade. This obser- 
vation plays a role in our analysis, as the proof of Theorem 1.8 proceeds 
by induction on the cardinality of the state space Sq. When \Sq\ = 1, the 
result of [5, 17] implies that the systems fits the simplest, degenerate, case of 
the RPC. For the induction step one needs to show that (£,Q) satisfies the 
property of indecomposability and robust quasi-stationarity. Indecompos- 
ability is evident. Robust quasi-stationarity is trickier as the function of the 
evolution of (£,Q) is different for every r. This obstacle is circumvented in 
the linear case by an appropriate scaling between r and the number of time 
steps of the evolution. The nonlinear case is reduced to the linear one using 
an argument based on the central limit theorem, where quasi-stationarity is 
needed for A in a neighborhood of 0. Since \Sq\ = \Sq\ — 1, the induction 
proof covers all cases of | Sq \ <oo. 

It is conceivable that the robustness assumption of Theorem 1.8 can be 
weakened. Quasi-stationarity under a single mapping is not enough, as it 
does not rule out a superposition of independently moving ROSt's which 
for the given ip happen to progress at a common velocity. It seems not 
unreasonable to expect that in situations other than the linear case, ip(n) = 
k, such degeneracy would be broken by requiring quasi-stationarity for the 
mapping corresponding to tp' = \ip for an open range of values of A. It is 
also not unconceivable that such a condition could directly yield robustness 
in the sense used in this work. These however are open questions. 

2. Ruelle probability cascades. In this section we briefly recount the 
structure and some of the essential properties of probability cascades which 
are constructed hierarchically from Poisson-Dirichlet processes. This is done 
here mainly in order to introduce the notation which is used throughout 
the paper. The framework, in particular with the insight of Bolthausen and 
Sznitman [8] , allows an extension of the definition to cascades with an infinite 
number of levels of splitting. In this article, we focus on the finite case. 
In discussing the quasi-stationarity we formulate a slight extension of the 
known stationarity property of the Poisson-Dirichlet processes. 

The probabilistic cascade models were introduced by Ruelle [16] as a 
way of giving expression to Derrida's asymptotic calculations of the N — > oo 
limits of a class of finite models [9] . Often they are referred to as GREM and 
REM, for (generalized-) random energy models, though this terminology runs 
the risk of confusing the finite models with their continuum reformulation. 
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A Poisson point process n on a Polish space S with intensity measure v 
is the integer- valued random measure whose finite-dimensional distributions 
are of the form 

F^A,) = mi, . . . , f](A n ) = m n ) = J] 1 k \ e~ v ^ 

fe=l mkl 

for disjoint measurable sets Af~ and G N. We are particularly interested 
in the Poisson processes on (0, oo) with intensity measure v{ds) = xs~ x ~ 1 ds 
for some x G (0,1), whose tail is given by the power law z/([s,oo)) = s~ x . 
(Some relevant basic properties of this process are mentioned in [2].) 

Definition 2.1. A Poisson-Dirichlet variable PD(x,0), x G (0,1), on 
{P m ,J-m) is the random mass-partition defined as 

£:= C^ieA 

where (r/j,z G N) are the ordered positions of the atoms of a Poisson process 
on (0, oo) with intensity measure xs~ x ~ 1 ds. 

It should be noted that the normalization is by a finite factor, since Ei 7 ?* < 
oo a.s. for x G (0,1). Furthermore, this factor can be almost surely deter- 
mined from the normalized weights of the mass partition, as in the following 
explicit statement whose proof is elementary (see, e.g., [2, 7]). 

Proposition 2.2. For r\ = (rj n ,n G N) a Poisson process, as above, and 
£ = (£ ri ,nGN) the corresponding PD(x,0) variable: 

lim n 1/x £ n =' -, 

n—>oo C 

where £ = Ei 7 ?* 7S ^ e normalizing factor relating £ and r\. 

In particular: (i) £ is measurable with respect to £, (ii) the process (C£n> n G 
N) is Poisson with intensity measure xs~ x ~ l ds, and (iii) the laws of Poisson- 
Dirichlet variables with distinct parameters are mutually singular. 

2.1. Definition of the hierarchical structure. The family of Ruelle prob- 
ability cascades or RPC's, including the ones with continuous branching, is 
parametrized by the space of probability measures on [0,1]. From this per- 
spective, the cascades with finite number of splittings are in correspondence 
with the discrete probability measures with finite number of atoms, one of 
which is located at 1. 

More precisely, for each number of level splittings, k G N, the distribution 
of the cascade is determined by the 2k parameters: 
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• the values taken by the overlaps 

< qi <■■■ <q k < qk+i = 1, 

• the parameters of the Poisson processes 

< xi < ■ ■ ■ < x k < Xfc+i = 1. 
These 2k parameters define a piecewise constant distribution function 

(2.1) *(?)== (°' for^JCW) 

[xi, for qe [qi,qi+i). 

This corresponds to a discrete probability measure on [0, 1] with k + 1 atoms. 

The cascade parametrized by x(q) is constructed as follows. Let a := 
(qi, . . . ,«fc) G N fc . It is convenient to define a{l) as the truncation of a up 
to the Zth component, that is, a(l) := (cti, . . . , a{). By convention, a(0) := 0. 
The collection of a G N fc and their truncations is naturally represented as a 
rooted tree with root 0, vertices a(l) and leaves a. Edges are drawn between 
a(l + 1) and its truncation a(Z), for every a G N fc and < I < k. The Poisson 
processes constituting the cascade are indexed by the vertices of this tree. 
Precisely, to each vertex a{l) and for every < I < k — 1, we associate an 
independent Poisson process rj a ^ with intensity measures rr^is -1 ^ 1 " 1 ds. 
The law of the RPC, seen as a ROSt, expresses this hierarchy of processes. 

We first define the point process r\ with atoms indexed by a G N fc 

(2.2) 7] = (i] a , a G N fc ) = (vlXP ' " " > « G 

where represents the position of the aj+ith atom of the Poisson pro- 

cess r] a ( l \ The point process rj = (r] a ,a G N fc ) retains some properties of 
the Poisson processes constituting it (see, e.g., [2]). In particular it can be 
ordered as it is summable. Hence we construct the random mass-partition 

(2-3) £ := (_^ )iGN Y 

As the atoms of £ are ordered, there exists a random bijection II : N — ► N fc 
such that n(i) = a if the ith point of £ has address a. This map induces a 
hierarchy of equivalence relations: for each I G {0, . . . , k} 

i~u ^ [n(*)](0 = [n(i)](0. 

In other words, i and j are equivalent under ^ if and only if and £j 
share a common ancestor at level / in the tree indexed by a. We write Ti 
for the partition of N induced by this equivalence relation. It is clear from 
the definition that i j for every /' < I whenever i ~i j, or equivalently 
Tii C T[. Let be the greatest I for which i and j belong to the same 
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block of T[. The overlap between the ith. point and jth point of £ is defined 
as 

( 2 - 4 ) Qij ■= Qi(i,j)+i, 

where < q\ < ■ ■ ■ < qk < qk+i = 1 are the overlap parameters of the cascade. 
The random matrix Q hereby constructed is clearly real symmetric with 
qu = 1. It is also positive definite. Indeed, define the Gaussian field indexed 
by N fc 

k 

(2.5) t«:=X! AK a(0' 

1=0 

where An a m are independent centered Gaussians with variance — qi 
for all a and < I < k. It is easily checked that the field G N) has 
covariance matrix Q thereby proving the positivity. 

Definition 2.3 (Ruelle probability cascade). A k-level Ruelle proba- 
bility cascade or RPC with parameter x(q) (or equivalently parameters 
< x\ < ■ ■ ■ < Xk < Xk+i = 1 and < q\ < ■ ■ ■ < < qu+i = 1) is the ROSt 
(£,Q) defined by (2.2) and (2.4). 

Recall that the rth power Q* r (in the sense of the entrywise product) 
is positive definite whenever Q is. In fact, if (£, Q) is a RPC then so is 
(£,Q* r ). An interesting property coming from the hierarchical organization 
of the cascade is the fact that the latter holds for any monotone increasing 
function of the entries. 

Proposition 2.4. Let F: [0, 1] — > [0, 1] be a strictly increasing function 
such that F{1) = 1. If (£, Q) is a k-level RPC, then so is (£,F(Q)) where 
F(Q):={F( qij )}. 

Proof. It suffices to take Ak g ^ i.i.d. centered Gaussian with variance 
F(q l+1 ) - F( gi ) in (2.5). □ 

Bolthausen and Sznitman (see Theorem 2.2 in [8]) introduced a simple 
description of the law of the cascade which avoids the reordering of the 
index a. The following formulation of their result will be used in the proof of 
Theorem 1.8. Note that the 1-level RPC with parameter x\ and q\ is simply a 
Poisson-Dirichlet variable PD(x\,0) together with the deterministic overlap 
matrix with nondiagonal entries q\. 

Theorem 2.5 [8]. Let (£,Q) be a k-level RPC, k > 1, with parameters 
x\ , . . . , Xfc and q\ , . . . , q% . Then: 
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1. £ and Q are distributed independently, and 

2. £ is a PD(xk,0) variable. 

3. The distribution ofQ can be constructed as follows. Let (£, Q) be a (k— 1)- 
level probability cascade with parameters f 1 ,---,^^- and ^-,...,% zli . 

■^fc -^fc Hk Hk 

Conditionally on Zei (i*,zGN) &e i.i.d ^-distributed random inte- 

gers, then 

(2.6) Qij = QkQi*j*, 

T> 

where = means equality of distributions. 

We stress the fact, used in the above, that any proper mass-partition 
£ = (& j * ^ N) can be seen as a probability measure on N where the integer 
i is sampled with probability £j. The auxiliary structure (£,Q) appearing in 
the construction is said to be the directing probability cascade. 

2.2. Quasi- stationarity of the cascade. As was stated previously, the Ru- 
elle probability cascades are examples of random overlap structures that are 
indecomposable and robustly quasi-stationary under the correlated evolu- 
tion, see, for example, [2, 4]. In discussing this claim, it is useful to bear in 
mind the following result on the shift of a marked Poisson-Dirichlet variable. 

Definition 2.6. Let C be a Polish space equipped with the probability 
measure /x, rj a Poisson process on M + , and £ be Poisson-Dirichlet process 
PD(x,0). The following are referred to as the corresponding (C, /i)-marked 
processes: 

rf := ((rH,Ci),i€ N), £ c := € N). 

The variable Cj is called the mark of the point i. 

The following statement provides a slight generalization of Proposition 
3.1 in [17]. 

Lemma 2.7. Let rj be a Poisson process on (0,oo) with intensity measure 
xs~ x ~ 1 ds and W.(-):C x R— > (0, oo) be a jointly measurable mapping such 
that 

M:= ! ! W*(K)fi(dc) Pc (dK) <oo 
Jc Jr 

for some probability measure (i(dc)p c (dK) = p(dcdn) on the product space 
(C xR). Consider a (C x R, p) marking of r\. Then the shifted process 



{r] i W c% (Ki),c i ) 
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is a (C , fi) -marked Poisson process with intensity measure Mxs x 1 ds and 

ji(dc):= S * W ?W Pe(dK) . 

The statement has an elementary proof using the characteristic functional 
of Poisson processes, or alternatively it also follows by a direct adaptation 
of the proof of Proposition 3.1 in [17]. It has the following immediate con- 
sequence. 

Corollary 2.8. In the notation of Lemma 2.7, consider a (C x R, p)- 
marking of a PD(x,0) variable. Then, the shifted process 

( &w c< («Q \ 
VEi&Wc, («,-)' V 

is a (C , jl) -marked PD(x,0). 

We will usually deal with the uncoupled case where p c {dn) does not de- 
pend on the mark c. Note that if moreover W c = W, then \x = fj,. 

For the latter case, let us describe the distribution of the past increments. 
Let 7r be the random permutation of N induced by the shift, that is: ir(i) = j 
if and only if v-v^l^T^ , is the 7th point of the evolved process. We consider 

k[ := K^-iuy This variable represents the past increment of the point that 
made it to the ith position. The distribution of £ N) is computed by 
simply considering mark. Lemma 2.7 shows that the past increments 

are i.i.d. with distribution 

W{K) x p(dn) 
M 

and independent of ( j2^w 1 (k ) ' ^ ^ ^ e no ^ e ^ or further references that 
the above remark is easily extended to the case where the points of the 
process are incremented by T independent steps. In this case, the past steps 
are again independent. 

Theorem 2.9. Let (f ,Q) be a k-level RPC for some k G N. Then (£,Q) 
is robustly quasi- stationary and indecomposable under the correlated evolu- 
tion (1-4) for any function ip satisfying Assumption 1.3. 

Proof. It suffices to prove quasi-stationarity for r = 1. Indeed, (£,(2* r ) 
is also a cascade by Proposition 2.4 hence it is quasi-stationary for the Gaus- 
sian field with covariance Q* r . As Q = F(Q* r ) for the increasing function 
F(q) = q 1 ^, we conclude that is quasi-stationary for the field with 

covariance Q* r . 
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The proof is by induction on k. In the case k = 1, the matrix Q is simply 
Qij = $ij + (1 — $ij)Q f° r some < q < 1. In particular, it is invariant under 
the correlated evolution. The field k can then be represented as 

where k c is a Gaussian with variance q independent of the i.i.d. Gaussians nf 
of variance 1 — q. Conditioning on k c , we have that the law of £ is the same 
independently of k c under the evolution by Corollary 2.8 taking W(k{) = 

e^( KC+K f) . The case k = 1 is proven. 

We now assume that all (k — l)-level cascades are quasi-stationary. By 
Proposition 2.5, the distribution of a /c-level cascade is such that £ is PD(xk,0) 
independent of Q and that there exists a {k — l)-level cascade (£, Q) such 
that 

(2.7) qtj = q k qi*j*, 

where (i* ,i € N) are independent ^-distributed random integers. In particu- 
lar, we can write 

K i = K i* ~l~ K { i 

where the k{ are i.i.d. Gaussians with variance 1 — q^ and (k?,1 G N) is a 
Gaussian field with variance quQ. 

Let us condition on (£,Q). Clearly, the process (£, Q) is equivalent to the 
(N, £)-marking of a PD(xi : ,0) variable 

£ N = (te,n,ieN) 

with the mark probability £ = £ N) by (2.7). Quasi-stationarity will be 
proven if we show that the evolved process is still a C-marked PD(xi-,0) 
with the same mark probability (in law). Conditionally on (nf,l £ N), the 
correlated evolution of (1.4) corresponds to the evolution of the marking 

in Corollary 2.8 with function W\{k{ ) = e^ K i +K i ) for I G N. Therefore, the 
evolved process is still a marked PD(xk,0). It remains to show that the law 
of the evolved directing cascade is the same as (£,0)- The mark probability 
after evolution is by Corollary 2.8 



(2i 



where e^ x <f^ := L 6 tZ^ '/'fo+V 1 ^ dz. Note that this function is well 



defined by Assumption 1.3. The reordering of the evolved mark probability 
in (2.8) induces a permutation of Q 
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where tt{1) = k\i and only if £j becomes the kth. highest mark weight in (2.8). 
Hence the evolution of (£, Q) induced by the evolution of (£, Q) is exactly 
a correlated evolution with function ip Xk ,q k - By induction, the law of (£,Q) 
is invariant under this correlated evolution. Quasi-stationarity of (£, Q) is 
proven. 

Indecomposability is also proven by induction on k. The case /c = 1 is 
obvious. Assume every (k — l)-level cascade is indecomposable. So is any 
/c-level cascade as 

= QkSQ(i*) = qkSg 
from (2.7) and the induction hypothesis. □ 

The existence of the directing cascade (£, Q) and its evolution as a marking 
of £ are two important elements that will reappear in the characterization 
of quasi-stationary laws. We are now ready to turn to the implications of 
quasi-stationarity of a ROSt. 

3. Quasi-stationarity under the free evolution. In this section, we study 
the over lap- independent or free evolution of random overlap structures. The 
evolution is by the mapping (1.4) where the variables £ N) are simply 
i.i.d. standard Gaussians, whose covariance matrix is the identity. We denote 
this mapping by $oo, and will write for the joint law of the ROSt and 
the Gaussian field. The goal is to characterize the law of random overlap 
structures that are quasi-stationary under the free evolution for a given 
function tp. The full description is stated as Theorem 1.9 in the Introduction. 

3.1. Characterization theorem. To achieve the desired characterization, 
it is necessary to assume that the evolution is nonlattice. The next theorem 
was proven in [5] based on the argument of Ruzmaikina and Aizenman [17], 
whose result is stated under somewhat more stringent assumptions. 

Theorem 3.1. Let £ be a random mass-partition such that £i 7^ 1 a.s. 
Let (Wj,i€N) be an i.i.d. sequence of positive numbers whose distribution 
has a density on (0,oo) and for which "£,\W X \ < 00 for any AgR. If the law 
of £ is invariant under the evolution 

(3-1) { ^ ie H)^(-^-,ien) , 

then it is a linear superposition of Poisson-Dirichlet distributions PD(x,0), 

xe (0,1). 
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The free evolution corresponds to the choice Wi = e^^ Ki \ Clearly, the 
assumptions of Theorem 3.1 are fulfilled when ip satisfies Assumptions 1.3. 
We conclude that the marginal distribution of £ must be a superposition of 
Poisson-Dirichlet variables. 

The key point of the proof of Theorem 1.9 is the fact that Q must be 
weakly exchangeable given £ (i.e., its law must be invariant under any finite 
permutation of the indices) . The properties of weakly exchangeable overlap 
matrices needed for the section are detailed in Appendix A. The proof of 
the weak exchangeability of the overlap matrix is given in the next section 
(Proposition 3.3). We first complete the proof of the theorem assuming this 
fact. 

Proof of Theorem 1.9. It will be proven in Proposition 3.3 that Q is 
weakly exchangeable given £. The characterization of weakly exchangeable 
covariance matrices of Dovbysh and Sudakov (Theorem A.l) guarantees the 
existence of a random probability measure /ionH such that the law of Q 
has the desired form conditionally on fx. Moreover, given fi, the law of Q 
does not depend on £ thereby proving the independence between £ and Q. 

It remains to prove that the law of £ conditionally of fx is invariant under 
the free evolution. The fact that it must be a superposition of PD(x,0) will 
then follow by Theorem 3.1. We write \xq for the probability measure making 
the dependence on Q explicit. We denote the overlap matrix of $00 (£) Q) by 
Q' . The claim will be proven if we show that the directing measure of Q is 
a <&oo-invariant, that is: for all measurable A C 7i 

(3-2) E 00 [fi QI (A)\f lQ ]= f i Q (A). 

The probability hq'(A) is the probability that the first point (or any point) 
of $oo(£>Q) has its mark <j)\ in A 

E^Hq^A^Hq] =Poo(&r-i(l) G A\hq), 

where n is the reshuffling induced by the evolution. By summing over all 
possibilities of leading points, we get 

E 00 [ ( i Q ,(A)\ ( i Q ]=J2Woo(ci>j G A, vr(j) = l\fi Q ). 
j 

As the increments k (and thus the reshuffling) are independent of the marks 
<j)j, the r.h.s becomes 

Y^¥(</, j eA\^ Q )F 00 {Tr(J) = l\^)=fi Q {A), 
j 

where we have used the fact that G A\[j,q) = ^q{A) for all j. The claim 
is proven. □ 
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We remark that the theorem is sharp in the sense that any random overlap 
structure where £ is a superposition of PD(x,0) and Q is constructed from a 
probability measure on Ti is quasi-stationary under the free evolution. This 
is a direct consequence of Corollary 2.8 for the choice C = TL when the shift 
function does not depend on the mark. In other words, quasi-stationarity 
under the free evolution does not constrain the form of the directing measure 
fi. However, we will see that indecomposability and the finiteness of the state 
space restrict the possible fi in a dramatic way. 

3.2. Weak exchangeability of the overlap matrix. We shall now prove 
that weak exchangeability of the overlap matrix is a necessary condition for 
quasi-stationarity under the free evolution. The proof is obtained by looking 
at the distribution of the past increments given the present positions of the 
points. 

Consider independent copies n'(t), < t < T — 1, of the field k composed 
of i.i.d. standard Gaussians. Let (£',(50 be a ROSt and define the evolved 
process (£, Q) after the T-step incrementation 

(f , Q) ■= % K '(t-i)) ° • • • % K '(o)) (£'. Q')- 

We define ttt as the reshuffling after these T steps, that is, 7Pr(i) = j if and 
only if 

The past Gaussian field at time —t, —T < — t < — 1, of the ith. point of (£, Q) 
is then 

(3.3) « i (-t):=/ S / 7r _ 1( . ) (T-t). 

Lemma 3.2. Let (£, Q) be a ROSt that is quasi- stationary under the free 
evolution for some function tp satisfying Assumption 1.3. Consider the past 
fields as defined in (3.3) for some T G N. There exists a T os -measurable 
parameter x such that, conditionally on x, the following hold: 

1. The fields n(t), —T < —t< —1, are independent of each other and of 

2. For fixed t, the variables t),i S N) are i.i.d. with distribution 

e x ^v{dz) 
f R e^%(dz'Y 

where v is the standard Gaussian measure. 
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Proof. We know from Theorem 1.9 that the law of £ is a superposition 
of PD(x,0). As the increments are independent of the overlaps, we can apply 
directly Corollary 2.8 and the remark following it to get the distribution of 
the fields «(-t), -T < -t< -1. □ 

Note that the field («(—£), i E N) is well defined as i.i.d. copies of «(— 1). 
In the rest of this section, we will write Pqq for the distribution of (£, Q) 
together with the law of the past and future Gaussian fields (k(— t),t G Z). 

Proposition 3.3. Let (£,Q) be a ROSt that is quasi-stationary under 
free evolution for some function ip satisfying Assumption 1.3. Then Q is 
weakly exchangeable conditionally on £, that is: for any permutation r of a 
finite number of elements of N 



Proof. Let us fix r, a permutation of a finite number of elements of N. 
Let n be the maximum over N of the elements for which r is not the identity. 
We write Q n for the n x n matrix of the overlaps of the first n points. Let 
Ii, i G N, be a collection of intervals of [0, 1]. We will write {£ £ /} for the 
event G £ N}. We need to prove that 



for any realization R n of Q n . 

Let ~K n -T ■ {1, • • • i n} — ► {1, . . . , n} be the reshuffling of the first n points 
from time — T to time 0, that is: 7r n ._r(z) = j if the jth point at time was 
the ith point at time —T among these n points (see Figure 1). We write 



(3.4) 



P(Q n = rR n r-\i el) = P(Qn = K, e e /) 



Time 



o 




Time -T 




-o- • — o • — O 



Fig. 1. An illustration of the permutations which occur through the time evolution. For 
each n £ N, the permutation tt„.-t describes the effect of the evolution from time —T on 
the n leading points of time 0. For example, in the depicted case 7T3,_t(2) = 1. 
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Q n -T for the overlap matrix of the ordered points at time —T that become 
the first n at time 

Qn-T = ^n-TQn^n-T- 

By decomposing P(Q n = ri? n T -1 ,^ E I) over all possible ir n -T and using 
conditioning, we get 

p'eSn 

xF 00 (Q nt - T = p'R n p'~\t£l). 

Equation (3.4) will follow if, for any permutation p£ S n and any realization 
R' n of Q n , 

(3-5) ¥ 00 (Tr n ,-T = p\Qn,-T = R' n ^eI)^-, 

as T — > oo . 

From the definition of 7r ni _r, the l.h.s. of the above equals 

Poc(£p(i)e- Sp(1)( ~ T) > • > e p (n)e- Sp( " ){ ~ T) IQn,-T = <,£ G /), 
where Sj(—T) := X)t=i K j( — *) ( see Figure 1); and by taking the logarithm 

Poo (A p(0 (T) > log ^!±il, i = l, . . . , n|Q n ,_ T = <, £ € /) , 

\ ?p(i) / 

where we wrote Aj(T) for T) — Si(—T). By Lemma 3.2, the re- 

dimensional variable (Ai(T), . . . , A n (T)) is a sum of T i.i.d. n-dimensional 
vectors conditionally on the J- oa -measurable parameter x. It is also indepen- 
dent of £ and the overlaps. We know from the specific form of its distribution 
that E[Aj] = for all i and E[AjA,-] = CTSij for some finite C. Dividing all 
inequalities in the above by \JCT does not change the probability and we 
get 

PooK-T = p\Qn,-T = <,£ € /) 




for some probability measure A on (0, 1). We can take the limit T — > oo inside 
the integral by dominated convergence and use the central limit theorem. 
As the positions £ are fixed, the r.h.s. of the inequalities goes to and the 
probability converges to 1/nl irrespective of x. Equation (3.5) is proven and 
the proposition follows. □ 
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4. Robust quasi-stationarity and hierarchical structure. We now turn 
to random overlap structures that are quasi-stationary under the correlated 
evolutions $ r for an infinite number of r G N. The complete description is 
stated in Theorem 1.8 for the case where the invariance holds for multiples 
of a smooth function ifj, and the overlap matrix has finite state space. 

4.1. Robustness and free evolution. We first show that robust quasi- 
stationarity under correlated evolution implies quasi-stationarity under the 
free evolution (Theorem 1.10). Using results of the previous section, 
this yields a precise form for the robustly quasi-stationary laws. The proof 
relies on the next lemma. It asserts that with large probability the parti- 
cles that are located in [5, 1] after evolution came from the first N before 
evolution. We state the result for T independent step of the evolution, as it 
will be needed later in the proof. We will write n(t), < t < T — 1, for T 
independent copies of the Gaussian field. 

Lemma 4.1. Let (£,Q) be a ROSt such that £ is a.s. proper, and <3? r a 
correlated evolution for some r G N and a function ip satisfying Assumption 
1.3. Let Ajvta<5 be the event that a particle initially beyond the Nth after 
T steps of the evolution ends within the interval [5, 1] : 

f (i eZl:t »(:«» 



i>N 



Then 



MMt,x,s) < kg(2\)g(-2\)) T / 2 J2 m\ 



i>N 



forg(\) = f u ^0e^)dz. 



Proof. Fix 5 > 0. Markov's inequality yields the elementary bound 



u 

i>N 




We use Cauchy-Schwarz inequality followed by two applications of Jensen's 
inequality with the functions f(y) = y 2 and f{y) = 1/y 2 on the r.h.s. to get 
the upper bound 

hg(2\)g(-2\)) T / 2 £e&]. 

i>N 

Note that the condition J2i & = 1 a - s - is needed to apply Jensen's inequality. 

□ 
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The important feature of the result is that the estimate is uniform in r 
for all evolutions <£ r . This allows us to take a rigorous limit r — > oo under 
which Q* r tends to the identity matrix thereby decorrelating the evolution. 

Proof of Theorem 1.10. As (£, Q) is quasi-stationary, we can assume 
that = 1 an d that there are an infinite number of atoms with £j > 0. 
Recall from Proposition 1.2 that the law of a ROSt is determined by the 
class of continuous functions that depend on a finite number of points. Let 
/ : £l os — > R be such a function depending on the first n points for some 
n G N. We will write /(£, Q) = . . . , £ n ; Q n ) for the explicit dependence 
where Q n = {Qij}i<i,j<n- Robust quasi-stationarity implies that for all r E N 

(4.1) E r [/($ r (£,Q))]=E[/(£,Q)]. 

The theorem will be proven by showing that the limit r — > oo of the above 
equation yields the equality for the free evolution, that is 

(4.2) E 00 [/($ 00 (^Q))]=E[/(^,Q)]. 
For 5 > 0, we define the function / with a cutoff 

/<s(£l> • • • ;£n;<2n) := /(Cl, • ■ • , £n, Qn)X{£ n >5}i 

where xa is the indicator function of the set A. Clearly, fg—*f a.s. when 
5 — > as ^ n > a.s. Let 5' < 5. We will need a variation of fs for which the 
points are normalized with respect to the sum of the points within [5' , 1] 

fs,S' (6: • • • > £n! Qn) : = f&{il/ N &' ,-•■■> Cn/Ns' ; Q n ), 

where 

N S ,:= £ 

Note that iVj/ — > 1 almost surely when 5' — > 0. Therefore, by continuity of / 
and the fact that 

J,™ X{«„/iV,,>a} -»X« n >«} 

we have 

lim lim (6 , ■ • ■ , Cn5 Qn) = /(6 , • ■ • , Cn! Qn) a.s. 

o — s-0 o — ^0 

In particular, by (4.1) and the dominated convergence theorem, 

(4.3) lim lim Km E r [/^(<I> r (£,Q))] =E[/(£,Q)]. 

On the other hand, let A C N s , be the event that all evolved points in [S',1] 
come from the first N before evolution (as defined in Lemma 4.1 with A = 1 
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and T = 1). Let us write 3> r (£, Q)\n f° r the evolution of the first N points 
of (£,Q). In this notation, the function fs,6'(&r(£,,Q)) when restricted to 
the event A C N s , only depends on $v(£> Q)|tv- Hence, by writing 1 = Xa c n , + 

nfsAM^Q))]=nfs, S '(^,Q)\N)xAoj 

(4.4) 

+ nfs,y(^,Q))XA N , s }- 

Clearly, the restriction to N points of Q* r tends to the identity matrix. 
Recall that convergence in distribution for Gaussian vectors is equivalent to 
convergence of the covariance matrix thus 

(4.5) lim E[f s ^ r {Z,Q)\ N )]=E[fs,s>(* 00 (Z,Q)\ N )]. 

r — >oc 

We can take N arbitrary large in (4.4) so that the probability of An,s is 
small uniformly in r by Lemma 4.1 thus 

Hm E[f StS , (<D r (£, Q) )} = E[fo s , (^ (£, Q) )} . 

Equation 4.2 is obtained from (4.3) by taking the limit 5, 5' — > of the above. 
□ 



We stress that although robust quasi-stationarity implies quasi-stationarity 
under free evolution, it is generally not true that structures that are ergodic 
under correlated evolution will be ergodic under the free evolution. Indeed, 
recall that for the free evolution the measure \i was $oo -invariant and 
therefore deterministic if (£, Q) is ergodic. We will see that this measure is 
never invariant under $ r . Understanding how this measure transforms under 
correlated evolution is the object of the next section. 

4.2. The directing random overlap structure. A combination of Theo- 
rems 1.10 and 1.9 guarantees the existence of a directing measure on a 
Hilbert space Ti in the case where (£, Q) is robustly quasi-stationary. With- 
out loss of generality, we can assume that Ti is a Gaussian Hilbert space. This 
perspective yields a representation of the Gaussian field k with covariance 

Q 

K i — (f>i + , 

where {k{ ,i G N) are independent centered Gaussian variables of variance 
1 — II ^« II 2 depending on i. In the case where k has covariance Q* r , r £ N, we 

(r) 

associate to each fa a vector cpi in such a way that 

(4.6) (4\<t ) f) = {faA 3 r. 
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This map is unique up to isometry of 7i. We then have the representation 
Ki = <f>(' + k{ where (k{ , i £ N) are independent centered Gaussian variables 
of variance 1 — \\4>i \\ r . 

Precisely, the combination of the two results yields: 

Theorem 4.2. Let (£,Q) be a ROSt that is robustly quasi-stationary 
and ergodic for a function ip satisfying Assumption 1.3. The following hold: 

1. £ is a PD(x,0) independent of Q for some x £ (0, 1); 

2. Q is directed by [i, a random probability measure on TC whose law, up to 
isometry, satisfies the equation 

f Kf (#) t '.»i> (,) 

where 

—z 2 /2 

(4.8) e^-" (v) := [ ^e 1 *^ 2 ^' dz. 



2tt 

Proof. Theorem 1.9 together with Theorem 1.10 ensures that the law 
of ^ is a superposition of PD(x,0) as well as the existence of the directing 
measure 

From the remark preceding the theorem, the correlated evolution $ r re- 
duces to the evolution of a (TC, [i) -mar king of a PD(x,0) variable for the 

choice WAk-1) '■= e^^ (r)+ft i ) (conditionally on /i and on the randomness 
of the Gaussian Hilbert space H.). Recall from Corollary 2.8 that a marked 
PD(x, 0) under such a stochastic map is again a marked PD(x, 0) with mod- 
ified mark probability. In particular, the x parameter is <£ r -invariant. Since 
(£,Q) is ergodic and PD(x,0) with distinct parameters are mutually singu- 
lar, we conclude that £ is simply a PD(x, 0) for some x £ (0, 1) independently 
of n and the randomness of 7i. The first claim is proven. Equation (4.7) is 
a consequence of quasi-stationarity and the form of jl in Corollary 2.8. □ 



In the next section, we solve the fixed point (4.7) in the particular case 
where Q is indecomposable with Sq finite. It is proven in Theorem A. 6 of 
Appendix A that under these assumptions the directing measure is discrete, 
of the form 

where the index set C is countable, £i > £2 > ■ • ■ > and the vectors (4>i,l G 
C) C have square norm q max := maxSg. 
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We construct a ROSt that is a representation of [i up to isometry. Plainly 
£ := E C) is a random mass-partition. The natural choice for the over- 
laps of £ is 

<Zfci := —(<f>k,<f>l), 

Qmax 

where <7 max := max5g. Note that <7 max = if and only if Sq = {0} as the 
vectors (pi must then have zero norm. The factor l/q max is added so that 
the diagonal elements are normalized to 1. Note that by definition 

S Q = n ( S Q ^ {<?max}), 

Imax 

so that \Sq\ = \Sq\ — 1. We say that (£,Q) is the directing ROSt of (£,Q). 

In the discrete case, the law of (£, Q) is equivalent to the law of a (C,£)- 
marking of £ with C := ((f>i,l £ £) C H. We write 

(4.9) £ c :=((£,&. ),i€N) 

for this marking where (i*,i£ N) are i.i.d. ^-distributed. The striking fact is 
that the evolution of fi in (4.7) directly translates into a correlated evolution 

of G,q) 

// f, e V'x,c x (v / t< ) ) \ \ 

(4-10) g— (r) ,f€£) , TtQn J , 

where 7r is obtained from the decreasing rearrangement of the evolved prob- 
abilities and the function ij)x, p (sfp-) is defined in (4.8). It is easily checked 
that this function satisfies Assumption 1.3. 

By the above remarks, Theorem 4.2 becomes the following. 

Proposition 4.3. Let (£,Q) be a ROSt that is robustly quasi- stationary 
and ergodic for some function satisfying Assumption 1.3. If it is indecom- 
posable and with finite state space, that is Sq = {q\, . . . , qt} for some — 1 < 
qi < ■ • ■ < qk < 1 , with k > 1 , then the following hold: 

1. £ is a PD(x,0) independently of Q; 

2. there exists a directing ROSt (£, Q) that is indecomposable with Sq = 
{21,... ,2^1} such that 

v 

qij qkqi*j* > 

where i* , i G N, are ^-distributed random indices; 

3. for all r for which (£,Q) is quasi- stationary, (£,Q) *s quasi- stationary 
(and ergodic) under the correlated evolution 3>~/, r (^/qT4>\ r ^) where ((fff\l £ 
£) is centered Gaussian with covariance Q* r and ip x p is defined in (4-8). 
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Proof. The law of (£,Q) must be invariant under the above evolutions 
for the same r as (£,Q) by robust quasi-stationarity. Moreover, ought 
to be ergodic as (£,Q) is Q-measurable. Q is indecomposable as for alii £ N 

q k SQ(n = S Q (i)\{q k } = S Q \{q k }. □ 

4.3. The hierarchical structure for linear ip. We now use an inductive 
argument based on Proposition 4.3 to single out the RPC's in terms of quasi- 
stationarity properties for linear ip. The induction is possible if one assumes 
robust quasi-stationarity under the evolution i/j(k) = Xk, where A = A r can 
depend on the power of the covariance matrix. 

Theorem 4.4. Let (£,Q) be an indecomposable ROSt with \Sq\ = k. If 
(£, Q) is robustly quasi-stationary, and ergodic under a sequence of evolutions 
with i/j(k) = X r K, for some uniformly bounded collection {A r }, then (£,Q) is 
a k-level RPC. 

The strategic step is to prove that the directing ROSt (£, Q) inherits the 
same properties as (£,Q). An induction on the cardinality of Sq completes 
the proof. An obstacle to this is the fact that the function for which (£, Q) is 
quasi-stationary is different for each field with covariance Q* r as seen from 
Proposition 4.3. In other words, (£, Q) is not robustly quasi-stationary for a 
fixed function ip. However, this problem is circumvented for = Xk. In 
this case, it is easily checked from the definition of ip XjP that the evolution 
is still linear since 

(4.ii) iPx,p{y/py) = x VP x y + c - 

The constant C := x 2 X 2 (l — p)/2 is irrelevant for the evolution because of 
the normalization. If (£, Q) is assumed quasi-stationary for all A, then so is 
(£) Q) since Xy/pX is a scaling of A. A similar induction is still true when 
quasi-stationarity holds for a single A using several steps of the evolution. 

Lemma 4.5. Let (£,Q) be a ROSt with a finite Sq = {q\, . . . ,q k }, which: 

1. is robustly quasi- stationary and ergodic under $ r with ip( K ) = X r n, X r 
uniformly bounded, 

2. is indecomposable, 

3. has Sq C (—1, 1). 

Then its directing ROSt (£,Q), with SU = . . . also satisfies the 

above three conditions. 

Proof. First we show that such ROSt's are quasi-stationary under the 
free evolution, that is, in the linear case the conclusion of Theorem 1.10 
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remains true even when A is allowed to depend on r. Indeed, consider T time 
steps of the evolution with T = T r . By the additive property of Gaussian 
variables, if (£, Q) is quasi-stationary under ip(n) = Xk, then it is quasi- 
stationary under XVTk for all T S N. Since A r is uniformly bounded, we 
can build a sequence X r \/T^ which converges to a nonzero limit as r — > oo. 
The increments X r \/T^Ki, where k has covariance Q* r , then converge weakly 
to i.i.d. nonzero Gaussians. Moreover, the estimate of Lemma 4.1 is also 
uniform in r since lim r ^oo g(X T ) Tr is finite. Quasi-stationarity under the 
free evolution then follows as in the proof of Theorem 1.10. In particular, 
following the same line of argument as in the previous section, we see that 
the conclusion of Proposition 4.3 remains valid when A depends on r in the 
linear case. This proves that the directing ROSt satisfies properties 1 and 2. 

It remains to show that Sq C (—1, 1). By definition of Q, it plainly follows 
that ijij 1 when i ^ j. Moreover, for a fixed i, there exists at most one j 
for which q^j = —1, so ftj(i) = —Kj(t) for all t. It is shown in [6] that the 
time-average V{ of the past increment must be the same for all points and 
is nonzero unless there exists only one point. This contradicts the existence 
of a pair q~ij = — 1 since in that case Vi = —Vj. The lemma is proven. □ 

We are now ready to prove Theorem 4.4. The proof is based on the de- 
scription of RPC's given in Theorem 2.9. 

Proof of Theorem 4.4. The proof is by induction on \Sq\. Recall that 
a 1-level RPC is simply a pair (£, Q) where £ is PD(x, 0) and Q is a constant 
matrix with all nondiagonal entries equal to q for some < q < 1. Let (£, Q) 
be as in the assumption of the theorem with Sq = {q} for —1 < q < 1. Note 
that the Gaussian field k with covariance Q is exchangeable. In particular, 
q is nonnegative. We can write 

where centered Gaussian with variance q common to every point and 

are i.i.d. centered Gaussians of variance 1 — q. As ip is linear, k c 
is irrelevant in the correlated evolution as it cancels in the normalization 
being common to every point. We conclude that (£, Q) is quasi-stationary 
and ergodic under the free evolution. By Theorem 3.1, £ is PD(x,0) and we 
conclude that (£, Q) is a 1-level RPC. 

Let \Sq I = k > 1 and assume the result holds in the case Sq takes k — 1 
values. By Proposition 4.3, £ has Poisson-Dirichlet distribution for some 
parameter Xk £ (0, 1) independently of Q. Moreover the law of Q is deter- 
mined by a directing ROSt (£, Q) with Sq = {qi/qk, ■ ■ ■ , Qk-l/Qk}- I n view 
of Theorem 2.9 on the law of the cascade, it remains to show that (£, Q) 
is a (k — l)-level RPC with parameters < x\jx^ < • • • < x^i/x^ < 1 for 



QUASI-STATIONARY COMPETING PARTICLE SYSTEMS 



29 



some < x\ < ■ • ■ < x^-x < 1 and that < qi/qk < • • • < qk-i/qk < 1- We 
know from Lemma 4.5 that (£,Q) satisfies the assumptions of the theorem. 
By the induction hypothesis, it is a (k — l)-level RPC for some parame- 
ters < x[ < ■ ■ ■ < x' k _ l < 1 and < qi/qk, ■ ■ ■ ,qk-i/qk < 1- The proof is 
completed by defining for I = 1, . . . , k — 1. The theorem is 

proven. □ 

4.4. The hierarchical structure for general tp. A slight adaptation of the 
proof of the linear case yields the main result of this work, as it is stated 
in Theorem 1.8. The proof is based on the evolution of the systems after T 
independent steps of the evolution taking T to infinity. An application of 
the central limit theorem then permits to reduce the evolution to the linear 
case. 

Throughout this section, we will assume without loss of generality that 



Note that we can always substract a constant to ip as the evolution is nor- 
malized and divide the function by its second moment as quasi-stationarity 
holds for multiples of tp in a neighborhood of 0. 
We define the covariance function 



where X and Y are standard Gaussians with covariance q. It is easy to see 
that C,), is a continuous function on [—1, 1] and that limq_*o (g) = 0. We 
can actually say more when ip is a smooth function by a simple Gaussian 
differentiation. 

Lemma 4.6. If ip :R— >M is in C 2 (M) with bounded derivatives, then 



monotone in a neighborhood ofO. 

Let k = (Ki,i G N) be the centered Gaussian field with covariance matrix 




and 




C^q) :=E[^(X)VCn] 





It turns out that the ROSt (£,Q(r)) inherits the quasi-stationarity property 
from (£,Q). 
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Lemma 4.7. Let ip be a function satisfying Assumption 1.3. If (£,Q) is 
quasi-stationary under $ r for every multiple Xtp, X in a neighborhood of 0, 
then (£,0( r )) *s quasi- stationary for the linear functions Xk. Moreover, if 
(£,Q) is indecomposable, then so is (£,Q(r)). 

Proof. The proof is identical to the proof of Theorem 1.10 in Section 
4.1. It suffices to replace <3? r by 

, Q) ®\/VTWk(t-i)) ° • • • ° $ a/Vtv(«(o)) • 
The requirement that quasi-stationarity holds for A in a neighborhood of 
ensures that (£,Q) is quasi-stationary after the scaling A — > X/VT. The 
probability of the event A N T x/y^f 8 °^ Lemma 4.1 is uniformly small in T 

when N is large since limr^oo g(X/ \/T) T < oo. The proof of Theorem 1.10 
thus applies. The equivalent of (4.5) is obtained through the iV-dimensional 
central limit theorem 

Km nf S , S >($T(t;,Q)\N)} =nf S ,A$Xkti,Q)\N)], 
1 — >oc 

where k is a centered Gaussian field with covariance Q(r). Indecomposability 
is clear from the fact that 

S Q(r)( i ) = C ^i S Q* r i i )) = C^(Sq-) = S§ {r) . □ 
We now have all the tools to prove Theorem 1.8. 

Proof of Theorem 1.8. By Lemma 4.7, (£,Q(r)) is robustly quasi- 
stationary under evolutions corresponding to the linear functions Xk for A 
in a neighborhood of 0. Due to the Q-factorization, we can assume that 
(£,Q(r)) is indecomposable. As discussed above Lemma 4.6, 

lim q(r)ij = <5y. 

Hence the proof of Theorem 4.4 holds verbatim with Q* r replaced by Q{r). 
We conclude that (£, Q) is a fe-level RPC. It remains to prove that so is 
(£,Q). Recall that 

(4.13) Q(r)i3 = CMi)- 

By Lemma 4.6, is stricly monotone in a neighborhood of 0, say V. In 
particular, it is invertible on V and C^" 1 : V — > [0, 1] is also stricly monotone. 
By choosing r large enough so that (max^g)'' belongs to V, we can invert 
(4.13) 

ql 3 =C^{q{r) l3 ). 

By Proposition 2.4, we conclude that (£, Q* r ) is a k-level RPC and conse- 
quently, that (£, Q) is. The theorem is proven. □ 



QUASI-STATIONARY COMPETING PARTICLE SYSTEMS 



31 



APPENDIX A: WEAKLY EXCHANGEABLE MATRICES 



The goal of this section is to prove that the directing measure of a weakly 
exchangeable overlap matrix must be discrete, under the assumption of in- 
decomposability and finiteness of the state space. This is done by defining 
a random partition of N from the random overlap matrix. Proof of the dis- 
creteness of the measure is then reduced to showing that the blocks of the 
partition are of nonzero density. 

A.l. Weakly exchangeable covariance matrices. A random N x N-matrix 
M is said to be weakly exchangeable if 



for any permutation r of finite elements of N. We say that a matrix is a 
covariance matrix in the case it is a real positive semi-definite symmetric 
matrix. A variation of de Finetti's theorem due to Dovbysh and Sudakov 
characterizes the random covariance matrices that are weakly exchangeable 
(see also a proof by Hestir [13]). 

Theorem A.l [10]. Let C = {cij} be a random NxN covariance matrix 
that is weakly exchangeable and for which E[cn] < oo. Then there exists a 
random probability measure fi onTC x [0, oo), with TC some separable Hillbert 
space, such that the law of C is given by 



where {(c/>j, aj)}j e r*j is an i.i.d. fj,- distributed sequence. 

We say that \x is the directing measure of C. The above result is sharp since 
any probability measure onHx [0, oo) can be used to construct a weakly 
exchangeable covariance matrix. 

In the notation of the above theorem, a weakly exchangeable random 
overlap matrix Q (i.e., a covariance matrix with qa = 1 for all i) is such that 
\\4>i\\ 2 + a « = 1 an d so the diagonal part cij is determined by fa. In particular, 
the directing ^ can be simply seen as a probability measure on TC. 

A. 2. Partitions of N and weak exchangeability. There is a natural ex- 
changeable random partition of N that can be constructed from a weakly 
exchangeable overlap matrix Q. 

Recall that a partition T o/N is a countable collections of disjoint subsets 
T := (Tj,j 6 N), also called blocks, for which 



tMt" 1 = M 




Ulj=N. 
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In this notation, we set Tj = for j large enough in the case the partition 
has finite number of blocks. Plainly, a partition T is determined by the 
equivalence relation 

i ~ j i and j belong to the same block of T. 

We say that a block 7 £ T has a density in case the following limit exists 

| 7 | : = lim -#( 7 n{l,...,n}). 

n — >oo ti 

Random partitions of N are random variables on the space of partitions of 
N, which is equipped with the er-algebra generated by the sets {T : i ~ j} for 
i,j £ N. The laws are constructed from consistent distributions on the space 
of partitions of {1, . . . , n}. A random partition of N is said to be exchangeable 
if and only if for all n £ N, its law restricted to {1, . . . ,n} is the same after 
any permutation of the n elements. 

An example of exchangeable random partitions is given by the so-called 
paintbox based on a mass-partition s [7] . The partition of N is constructed by 
pairing the weights of s to disjoint intervals of [0, 1] in such a way that the 
length of the interval l{ equals the weight Sj. Taking (Ui,i £ N) i.i.d. uniform 
random variables on [0, 1] , the partition is defined by the equivalence relation 

i ~ j <^=^ Ui and Uj belongs to the same interval of the partition. 

It is easy to see that each block of a paintbox has a density corresponding to 
the corresponding weight of s. Moreover, the densities are strictly positive 
if and only if s is proper, that is Yli s» = 1. Exchangeable random partitions 
of N are characterized in the following theorem of Kingman. 

Theorem A. 2 [7]. Let T be an exchangeable random partition of N. 
Then its law is a linear superposition of paintboxes. Equivalently, T is paint- 
box based on a random mass-partition. 

Following Kingman's idea, we construct an exchangeable random parti- 
tion of N from a weakly exchangeable overlap matrix Q as follows. In view 
of Theorem A.l, we define the equivalence relation 

i~j (j>i = (t>j, 

where (<j)i,i £ N) is the collection of random elements of Ti. whose existence 
is asserted by the theorem. We write Tq for the random partition of N 
induced by this equivalence relation. As (4>i,i £ N) is exchangeable, so is 
this partition. A straightforward application of Theorem A. 2 shows that the 
law of Tq is a superposition of paintboxes. However, there is no reason a 
priori for the random mass-partition on which Tq is based to be proper. It 
would be so if the blocks of Tq have positive density a.s. We introduce two 
sufficient conditions on the overlap matrix for this to hold. 
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Assumption A. 3. The set of values taken by the nondiagonal entries 
of the ith row, Sq(i) := {qij :i> j}, satisfy the following: 

1. \S Q (i)\ < oo for all i G N Q-a.s., 

2. Sq(z) = -S'q(j) for all i,j G N Q-a.s., in which case we write Sq for the 
common set of values. 



In the simple case where Sq = {q}, the overlap matrix must be of the form 
Qij = <z(l — + <%• Therefore the restriction of the measure /U to the space 
Ti is entirely supported on a single vector of square norm q. In particular, 
q must be nonnegative. The next results generalize the above reasoning to 
the case where Sq is finite. 

Lemma A. 4. Let Q be a weakly exchangeable overlap matrix, Tq its 
associated random partition of N, and (^,i€ N) the random sequence de- 
termining Q in Theorem A.l. If Q satisfies Assumption .4.5(1), then 

\\fr\\ 2 £S Q (i), 

and in particular max5g(i) is nonnegative. Moreover, almost surely: 
(A.l) lim -#{i + l<j <i + n: qij = \\(f>i\\ 2 }>0. 

n— *oo n 

Proof. Consider for fixed i the sequence ((4>i,4>j),j > i)). The first 
claim will be proven if for all 6 > 0, there exists almost surely a j > i such 
that 

(A.2) |(&,&)- 

Indeed, this would show that the nondiagonal entries come arbitrarily close 
to the square norm and the result follows by the finiteness of Sq. Equation 
(A.2) will be established if for all i G N and 6 > 

(A.3) /i({<AGW:|(<A,^)-H^I| 2 |<^})>0 
as we will have 

M ( fKIO^i) - ll^ll 2 ! ^ *}) = -KM) - \M 2 \ > s}) 

j>i \j>i I j>i 

= lim Ki<f>-\(<l>i^)-\\4>i\\ 2 \>S}) N 
= 0. 

Let (4>i,i G N) be a sequence of i.i.d. //-distributed. Note that for all e > 0, 
we must have 

(A.4) Li{{<peH:U-&\\ <£})>0 (&,ieN)-a.s. 
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for all i G N. On the other hand, for all e > there exists a 5 such that 

{</> g n ■. U - <t>'\\ < 4 Q {0 e w : |(& </>') - ll^'ll 2 < <J}. 

Equation (A. 3) is obtained from the above and (A. 4). Equation (A.l) is 
obvious from the fact that {4>i,<j)j) takes a finite number of values and the 
sequence ((4>i,(f)j),j > i) is i.i.d. □ 

Lemma A. 5. Let Q be as in Lemma A. 4- If Assumption A. 3(H) is also 
satisfied, then the following hold: 

1. The directing measure [i on H is almost surely supported on elements 
with uniform square norm max Sq 

||0i|| 2 = maxSg foralliGN. 

In particular, i and j belong to the same block of Tq if and only if = 
max Sq . 

2. Every block of Tq has positive density. In particular, Tq is a paintbox 
based on a proper random mass-partition. 

Proof. Fix i£N. From Cauchy-Schwarz, it is clear that for all j G N 

Qij < IWIII^jll < maxSQ 

as \\<pk\\ 2 £ Sq for all k £ N by Lemma A. 4. Moreover, by Assumption A. 3(h) 
there must exist a j > i such that qij = max Sq. Therefore from the above 
equation 

max Sq = maxgjj < H^IKmaxSg) 1 / 2 < maxSg. 
j 

We conclude that \\(j)i\\ 2 = max Sq. Furthermore, from 

< \\<pi - (j)j\\ 2 = 2maxSQ - 2qtj, 

we deduce that i and j are in the same block of Tq if and only if q^ = max Sq . 
The last claim is obtained from (A.l) and the first assertion. □ 

The main result of this section gives a description of the directing measure 
\i under Assumption A. 3: it must be supported on a countable collection of 
vectors. 

Theorem A. 6. Let Q be a weakly exchangeable overlap matrix satisfying 
Assumptions A. 3. Then the directing measure n of Q on H. is of the form 

The index set C is countable, (4>i,l G C) is a collection of elements of TL 
of square norm max Sq, and p := (pi,l G C) with p\ > p2 > • • • > are the 
corresponding probability weights. 
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Proof. We recall that Tq is based on a proper random mass-partition 
say p. Consider (pi,l& C) ordered in a decreasing order of pi > 0. By defi- 
nition of the equivalence class of Tq, for each class there is an identifying 
vector in the Hilbert space 7i. Reindex these elements in decreasing order of 
probability (with multiplicities resolved through an ordering oiTi). In this 
way we obtain the collection (<f>i,l £ C) on which p is supported. □ 

Acknowledgments. We thank Jason Miller for valuable comments on the 
first version of the paper. 
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